Customer No. 22,852 
Attorney Docket No. 05225.0166-01 
Application No. 10/634,768 

AMENDMENTS TO THE CLAIMS: 

This listing of claims will replace all prior versions and listings of claims in the 

application: 

1-22 (Canceled) 

23. (Currently Amended) A multimedia information collection control 
apparatus, comprising: 

a multimedia information collection unit configured to collect multimedia 
information from a plurality of kinds of input devices , including a camera and a 
microphone : 

a multimedia correspondence memory configured to correspondingly store the 
multimedia information including an image and a speech; 

a display configured to output the image and an attribute selection window 
including a plurality of attribute items of characters; 

an indicator configured to artificially specify a recognition area of the image on 
said display bv using a mark, a shape of the mark corresponding to a kind of a 
recognition object; 

an information recognition unit having a plurality of knowledge dictionaries each 
corresponding to each of the plurality of attribute items, configured to select one 
attribute item from the plurality of attribute items in response to a user's indication, to 
recognize characters in the imag e recognition area by using one of the plurality of 
knowledge dictionaries corresponding to the one attribute item and the kind of the 
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recognition object , to extract personal data from the recognition result of the characters, 
and to identify a speaker from the speech; and 

a multimedia database configured to relational^ store the multimedia information 
in correspondence with the identified speaker by using the personal data. 

24. (Canceled) 

25. (Canceled) 

26. (Currently Amended) The multimedia information collection control 
apparatus according to claim [[25]] 23, 

wherein the plurality of attribute items include a date, a meeting name, a place, a 
card, a name, a company name, a telephone number, a section name, an address, and 
an utterance content. 

27. (Previously Presented) The multimedia information collection control 
apparatus according to claim 26, wherein said indicator artificially selects one attribute 
item corresponding to the characters in the image from the plurality of attribute items of 
the attribute selection window on said display. 

28. (Previously Presented) The multimedia information collection control 
apparatus according to claim 27, wherein, if the one attribute item is a card, said 
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information recognition unit recognizes the characters in the image by using one 

knowledge dictionary corresponding to the card. 

29. (Previously Presented) The multimedia information collection control 
apparatus according to claim 28, wherein if the one attribute item is a card, said 
multimedia database stores the recognition result of the characters of the card as the 
speaker's personal data. 

30. (Previously Presented) The multimedia information collection control 
apparatus according to claim 29: 

wherein said information recognition unit includes a speech recognition unit 
configured to recognize the speech in the multimedia information; and 

wherein said multimedia database stores the recognition result of the speech in 
correspondence with the speaker's personal data. 

31 . (Previously Presented) The multimedia information collection control 
apparatus according to claim 29: 

wherein said information recognition unit includes a face recognition unit 
configured to recognize a facial characteristic of a face area in the image; and 

wherein said multimedia database stores the recognition result of the facial 
characteristic in correspondence with the speaker's personal data. 
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33. (Currently Amended) The multimedia information collection control 
apparatus according to claim [[32]] 23, wherein said information recognition unit extracts 
an area specified by the mark from the image, recognizes an object in the area by using 
the recognition method for the kind of the recognition object corresponding to the shape 
of the mark. 

34. (Previously Presented) The multimedia information collection control 
apparatus according to claim 33: 

wherein said display presents a plurality of recognition area indication buttons 
each corresponding to different kind of the recognition object; and 

wherein said indicator artificially points to the recognition area of the image on 
said display, and artificially selects a recognition area indication button corresponding to 
the kind of the recognition object in the recognition area. 

35. (Previously Presented) The multimedia information collection control 
apparatus according to claim 34: 

wherein said display presents the mark of the shape corresponding to the kind of 
the recognition object of the selected recognition area indication button on the 
recognition area; and 

wherein said indicator artificially adjusts a size and a position of the shape of the 
mark to the recognition area on said display. 
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36. (Previously Presented) The multimedia information collection control 
apparatus according to claim 35, wherein said information recognition unit selectively 
uses a plurality of recognition methods each corresponding to a different kind of the 
recognition object according to the selected recognition area indication button. 

37. (Previously Presented) The multimedia information collection control 
apparatus according to claim 23, wherein said multimedia database correspondingly 
stores a record identification of each item of the multimedia information. 

38. (Previously Presented) The multimedia information collection control 
apparatus according to claim 37: 

wherein said multimedia information collection unit includes an information 
addition unit configured to additionally input information to said multimedia database; 
and 

wherein said multimedia database additionally stores the input information for 
corresponding multimedia information. 

39. (Previously Presented) The multimedia information collection control 
apparatus according to claim 37, further comprising a dialogue control unit configured to 
input a retrieval request from a user, to analyze the retrieval request, and to generate a 
retrieval key according to the analysis result. 
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40. (Previously Presented) The multimedia information collection control 
apparatus according to claim 39; 

further comprising a retrieval control unit configured to retrieve the multimedia 
database by comparing the retrieval key with the record identification of each item of the 
multimedia information; and 

wherein said multimedia information collection unit presents the retrieved 
information through said display. 

41 . (Currently Amended) A method for controlling collection of 
multimedia information, comprising: 

collecting multimedia information from a plurality of kinds of input devices^ 
including a camera and a microphone ; 

correspondingly storing the multimedia information including an image and a 
speech; 

displaying the image and an attribute selection window including a plurality of 
attribute items of characters; 

artificially specifying a recognition area of the image bv using a mark, a shape of 
the mark corresponding to a kind of a recognition object; 

preparing a plurality of knowledge dictionaries each corresponding to each of the 
plurality of attribute items; 

selecting one attribute item from the plurality of attribute items in response to a 
user's indication; 
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recognizing characters in the imaee recognition area by using one of the plurality 
of knowledge dictionaries corresponding to the one attribute item and the kind of the 
recognition object ; 

extracting personal data from the recognition result of the characters; 

identifying a speaker from the speech; and 

relationally storing the multimedia information in correspondence with the 
identified speaker by using the personal data. 

42. (Currently Amended) A computer program product, comprising: 
a computer readable program code embodied in said product for causing a 
computer to control collection of multimedia information, said computer readable 
program code comprising: 

a first program code to collect multimedia information from a plurality of 
kinds of input devices, including a camera and a microphone : 

a second program code to correspondingly store the multimedia 
information including an image and a speech; 

a third program code to display the image and an attribute selection 
window including a plurality of attribute items of characters; 

a fourth program code to artificially specify a recognition area of the image 
by using a mark, a shape of the mark corresponding to a kind of a recognition object; 

a fourth fifth program code to prepare a plurality of knowledge dictionaries 
each corresponding to each of the plurality of attribute items; 
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a fifth sixth program code to select one attribute item from the plurality of 
attribute items in response to a user's indication; 

a sixth seventh program code to recognize characters in the imag e 
recognition area by using one of the plurality of knowledge dictionaries corresponding to 
the one attribute item and the kind of the recognition object ; 

an sev e nth eighth program code to extract personal data from the 
recognition result of the characters; 

a[[n]] eight ninth program code to identify a speaker from the speech; and 

a ninth tenth program code to relationally store the multimedia information 
in correspondence with the identified speaker by using the personal data. 



